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ABSTRACT 

An alternative to multiple^choice (MC) testing is 
suggested as it pertains to the field of radiologic technology 
education. General principles for writing MC questions are given and 
contrasted with a new type of MC question, the alternate-choice (AC) 
question, in which the answer choices are embedded in the question in 
a short form that resembles real speech and the way in which material 
is taught. In a small study of the use of these questions, 10 
students in a radiographic techniques course took a quiz in half MC 
and half AC formats. The quiz covered the initial lecture topic of 
radiographic density. Higher validity was found for the MC questions, 
which could be considered mere difficult and better predictors of 
learning. Results do not support the value of AC questions, but it is 
suggested that radiologic technology educators can use a similar 
method to study the usefulness of AC questions. Three tables present 
the checklist for evaluating MC items and study findings; (SLD) 
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ABSTRACT 

This article describes general principles for writing 
multiple-choice questions for radiologic technology education. 
Following this review, a description of a newer type of multiple- 
choice question, the alternate-choice question, is presented. A 
small ^i^-jdy of the use of these question is described in a riianner 
easily duplicated by radiologic technology instructors interested 
in the potential use of these questions. 
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INTRODUCTION 

In radiologic technology, and the health professions in 
general, there is a strong focus on using multiple-choice test 
questions. This is due to a variety of factors, most probably 
the fact that registry and licensure boards make the most use of 
these types of questions* This article will review the writing 
of multiple-choice questions, some recent research on a "newer" 
form of multiple-choice question, the alternate-choice item, and 
review a small study of alternate choice questions in a 
radiography program that other instructors can duplicate to see 
if these types of questions have utility in their own progr^ns. 
WRITING MULTIPLE-CHOICE QUESTIONS 

A nxjltiple-choice question is a form of forced-choice 
(objective) question, consisting of a stem, which presents the 
problem, and a list of alternate answers including the correct 
response and distr actors, which should be plausible, but 
incorrect or "not best/'i The following rules must also be 
observed when writing multiple-choice items: 

■ Must consist of a problem. 

■ Alternate answers should be kept as short as possible, 
and of the same approximate length. 

■ Stems should consist of few negatives (after all, 
students tend to learn positive information; the do's 
rather than the don'ts more readily). 

■ Items should be independent of each other. 

■ Gramratical clues should be avoided. 
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■ "None of the above" should not be used or only if it 
is either right or wrong. That is, it should not be 
used when writing a best answer question. 

■ Some authors also recomnnend against using of "all of 
the above" a student with only partial knowledge could 
get the item right. Yet sometimes clinical decisions 
must be made based on a partial, yet correct, 
knowledge of some of the facts. 

A checklist that can be used wheri writing multiple- 
choice items can be found in Tsible I . Advantages and 
disadvantages of multiple-choice questions are listed in Table 
1 I . 

The biggest problem from a professional standpoint of 
multiple-choice tests is their focus on simple recall of facts. 
Novice writers especially tend to write items that test recall. 2 
A skilled instructor and item writer ccin write a good test using 
any test format - yet this can require considerable effort. 
Professional item writers for tests like the ACT are expected to 
write about ten items per day. Instructors often write a test 
within an hour or less. Such tests, even after years of 
testing, are prone to at least a few errors. 

To evaluate student's clinical ability, standardized 
tests such as the registry use the test item known as K-type 
(complex multiple-choice item as opposed to the A-type, which 
consists of the single-best answer) to test for clinical ability. 
Yet research indicates that K-type items are not superior in 
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testing for complex cognitive knowledges and thus, many licensing 
boards have discontinued their use. Ideally, sane form of 
simulation or performance test to test for clinical knowledge 
would be used. The cost and rmnpower involved are obviously 
prohibitive. 

THE ALTERNATE CHOICE C3UESTI0N 
In 1982 Ebel proposed a new type of test question he 
called alternative choice (AC) .4 Ebel noted that most clinical 
situations have as few as two choices, sometimes three. 
VanSustern, Cohen, and Simpson give the following as an 
example of an AC item: 

Ascending cholangitis usually occurs (a. before; b. 
after*) obstruction of the cormon bile duct. 5 
In radiography, when choosing technique factors, for 
example, the usual choices are between mAs and Kvp. A test 
question that asks about the use of distance to change density on 
a film might be theoretically correct but confusing to a student. 
A student must know that FFD changes will affect density but the 
clinical application of such a change is limited. For example: 
To increase density on a radiograph: 

1 . I ncrease Kvp 

2 . I ncrease fnAs 

3. Decrease distance (FFD) 

a. 1 and 2 only b. 1 and 3 only 

c. 2 and 3 only d. 1,2, and 

An example of an AC, best answer question similar to the 



* - the asterisk indicates a correct response 
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above would be: 

(a, increasing kvp; b. Increasing nr^As* ) is the method 
usually preferred to increase optical density on a 
radiograph. 

Similarly, this question: 

The baseline between the external auditory meatus and the 

outer canthus of the eye is called the: 

a. orbitomeatal line* b. acanthiomeatal line 

c. mentomeatal 1 ine d. sagittal 1 ine 

Would become, eliminating the less plausible distr actors of 
mentomeatal line and sagittal line: 

The ( a. orbitomeatal line*; b. acanthiomeatal line) is 

the baseline between the external auditory meatus and the 

outer canthus of the eye. 

The second choice is preferable to many instructors as it 
more closely resembles normal speech and how the information 
would be taught in the classroom. 

Van Susteren tested the use of AC items with 
undergraduate psychology students and found that they were 
satisfactory in terms of difficulty, discrimination, and 
reliability as well as superior to A-type iterre in tei^ms of 
testing for conceptual knowledge. 6 Maihoff and Mehrens took 
"old" multiple choice questions with four or five choices and 
eliminated all choices except for the correct answer and the 
most attractive distractorA*? The items created were less 
difficult but not less discriminating in testing for knowledge 
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and application. This is advantageous in that the instructor can 
still determine the level of student understanding of the 
material while reducing the frustration level of students. Some 
instructors think that the rnore difficult a test is, quality of 
the test increases proportionally* Trickery, such as using 
double or even triple negatives, is counterproductive to 
learning. 



discipline of radiologic technology has been VanSusteren, Cohen, 
and Simpson's use of the AC format with second-year medical 
students in a pathology course. They found that: 



1. AC items were less difficult, but more reliable than 
A- or K-type questions. 

2. The AC format was more versatile in testing for 
clinical applications than other questions. 

3. The free form style of the question allowed for a 
more gramatically natural question that reflected how 
the question would be asked during clinical practice. 
Thus, the question format was similar to how the 
material was taught. 5 

A critique of alternate choice questions could be that 



they are also, to a certain extent, true-false questions. However, 
clinical practice is also often a ''yes-no," "more-less," higher- 
lower" decision--making process. They are also easy (and thus a 
relief) to write, as they are more easily extractable from 
lecture notes arid texts, and resemble normal speech. Many 



The research test of AC questions closest to the 
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instructors are familiar with the dilerma of finding three 
plausible distr actors. If alternate choice questions provide 
enough choices to determine student learning, then the process of 
writing questions would be facilitated. 

A SMALL STUDY OF ALTERNATE CHOICE QUESTIONS 
In 1976 Patricia Cross called for an increase in 
classroom research by instructors actually engaged in teaching to 
improve quality of instruction and reshape curriculum. 8 She 
noted that coimjnity college educators in particular have the 
resources to determine effective classroom learning strategies 
through applied research. Such research should be relevant to, 
and easily duplicated by, other instructors engaged in classroom 
teaching. This small study is designed to determine the 
applicability of AC questions in one setting and to present that 
research in a manner duplicable by other educators not only in 
this, but in other settings as well. 

Ten students participating in a first-year, third 
semester course in Radiographic Technique formed the sanple 
group. One of the regular quizzes for the course was specially 
designed as one-half regular multiple-cf.:>ice (10 questions); and 
one-half alternate-choice (10 questions). This quiz covered the 
initial lecture topic of Radiographic Density. The quiz was 
analyzed for face validity by faculty members from another CAHEA- 
accredited radiographv program. 

The average score on the quiz was 14.4 (72.2%), with a 
standard deviation of 2.58 (Table 111). This is consistent with 
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scores previously achieved by this group of students in courses 
taught by this instructor. 

The test was also scored separately for the AC and 
multiple choice questions. The average score on the AC questions 
was 8,0 (80^), with a standard deviation of 1. The average score 
on the section of regular multiple-choice questions was 6.4 
(64%), with a standard deviation of 2.32 . 

The rank difference correlation (Spearman rho) was used 
to determine the relationship (r) between the two sets of scores. 
This test was calculated as described in Isaac and Michael (pg. 
172). 9 A correlation coefficient is the statistic?*" method of 
choice in this case as the relationship between vai .wioles is of 
primary importance. It measures to what extent variables in one 
factor (scores on the AC items) go with with variations in 
another (multiple-choice items). Thus scores on the AC items 
should correlate with multiple-choice items if both items measure 
student learning of a topic. 

The value of r was 0.23, which was not statistically 
significant at either the ,05 or .01 levels (8 df). A 
correlation coefficient ranges from -1.00, in which case changes 
in one variable are accompanied by equivalent changes in the 
opposite direction of the other variable, to 1.00. A perfect 
positive correlation of 1.00 indicates that changes in one 
variable are accompanied by equivalent changes in the ssfr\e 
direction of the other variable. The weak positive correlation 
indicates that there is some positive association, but it could 
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well be attributed to chance. 

This indicates that it cannot be assumed, with reasonable 
certainty, that both types of questions possess similar validity 
in rT)easurin9 student learning in the population. The four-choice 
multiple-choice questions could be considered more difficult, as 
well as possibly a better predictor of learning. An item 
analysis using chi-square (Isaac and Michael, pp, 116-117) 
indicated that only one of the AC items should be retained, 
whereas eight of the multiple-choice items should be retained. 

CONCLUSION 

In this small study, AC questions were 'X)t found to be of 
••'Hlue. This study was limited in its focus, and was not intended 
to answer broad-scale questions about AC items such as their 
applicability to clinical judgment or their use in other 
settings, It is certainly possible, for example, that the 
questions used in the AC section were simply comparatively easy 
for students. One planned follow-up to this study is to develop 
a test similar to the one developed by Maihoff and Mehrens, 
eliminating the two most implausible distractors. 

Radiologic technology educators can use a similar method 
to the one described here of developing a test with equal numbers 
of two types of questions and calculating a correlation 
coefficient to determine a relationship between the two types. 
This can be performed with any two types of test items. Some 
educators feel, for example, that essay questions provide a good 
gauge of clinical knowledge. This could be evaluated in a 
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similar mar.ner. Knowing what types of questions are the most 
effective will be of value to the educator wanting to evaluate 
all types of student learning. 
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Table I 

Checklist for Evaluating Multiple-Choice Itetre* 



Check the Suggestions you feel you have followed. 



When possible, the stem was stated as a direct question 
rather than as an inconplete statement. 

A definite, explicit, and singular question or problan 
was stated in the stem. 

Excessive verbiage and irrelevant information was 
eliminated from the stem. 

Included in the stem word(s) that would otherwise be 
repeated in each, or a few items. 

Negatively stated items used sparingly, and underlined 
when used. 

Made all items plausible. 

Alternatives are gramratical ly parallel and consistent 
with stem. 

When possible, alternatives are presented in logical 
order - most to least or some other order. 

Only one correct or best response (A-type item). 

Alternatives are approxirnately equal in length. 

Used ''none of the above" or "all of the above" 
sparingly. !f used, they are occasionally correct. 

Attempted to balance the number of correct responses 
between choices of a,b,c,d, etc. 



* Adapted from Ory JC: Innproving Your Test Questions . Urbana, 
IL: Office of Instructional aind Management Services of the 
University of Illinois, 1983. 
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Table 1 1 

Advantages and Disadvantages of Multiple-Choice CJuestions 



Advantages 

Versatile in measuring al 1 levels 
of cognitive ability and content. 

Very reliable test scores. 

Efficient and accurate to score. 

Provide diagnostic feedback 
based on response to distractors. 



D isadvantages 

Difficult and time- 
consuming to construct. 

Favor simple recall of 
facts . 

Place high dependence 

on student reading ability. 

Instructor must be a good 
writer. 
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Table I I I 
Results 



14.4 (sd = 2.58) 
8.0 (sd = 1) 
6.4 (sd = 2.32) 
.23* 

* not significant at the .05 or .01 level 



Average score (20 items) 

Average score (10 AC items) 

Average score (10 nnultiple-choice items) 

r 
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